Integration of Multimodal Interaction as Assistance in Virtual Environments
نویسندگان
چکیده
This paper discusses the significance of the multimodal interaction in virtual environments (VE) and the criticalities involved in integration and coordination between modes during interaction. Also, we present an architecture and design of the integration mechanism with respect to information access in second language learning. In this connection, we have conducted an experiential study on speech inputs to understand how far users’ experience of information can be considered to be supportive to this architecture.
منابع مشابه
Virtual environments and sensory integration: Effects of aging and stroke
Research was carried out on the effects of aging and sensory motor defi cits following strokes with respect to the capacity of the central nervous system to resolve sensory confl icts created by Virtual Reality (VR). The results of this research demonstrate that VR can be a valuable tool for therapeutic interventions that require an adaptation to complex, multimodal environments. The rehabilita...
متن کاملVisual Touch in Virtual Environments: An Exploratory Study of Presence, Multimodal Interfaces, and Cross-Modal Sensory Illusions
How do users generate an illusion of presence in a rich and consistent virtual environment from an impoverished, incomplete, and often inconsistent set of sensory cues? We conducted an experiment to explore how multimodal perceptual cues are integrated into a coherent experience of virtual objects and spaces. Specically, we explored whether intermodal integration contributes to generating the ...
متن کاملChapter 25 : Multimodal interaction modeling
Virtual Environments (VE) represent advanced human computer interaction systems, communicating over several channels of information. The basic terms we need to describe human VE interaction are “communication channel” and “multimodality”. The communication channel is as a pathway between the user and the simulation that mediates the interaction. Multimodality is the quality of a system, which a...
متن کاملImproving results of urban design research by enhancing advanced semiexperiments in virtual environments
There is abundant literature regarding virtual reality as a technology of interest in the present age. However, there are few comprehensive studies on strategies that can improve the level of urban design research using this technique. To investigate the issue, this paper first reviews the concept of virtual reality. Next, the opinions of experts in the field of virtual reality technology are s...
متن کاملHuman Computer Interaction Using Vision-Based Hand Gesture Recognition
With the rapid emergence of 3D applications and virtual environments in computer systems; the need for a new type of interaction device arises. This is because the traditional devices such as mouse, keyboard, and joystick become inefficient and cumbersome within these virtual environments. In other words, evolution of user interfaces shapes the change in the Human-Computer Interaction (HCI). In...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2012